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Abstract 



We derive analytical results for the large-time relaxation of the Sherring- 
ton - Kirkpatrick model in the thermodynamic limit, starting from a random 
configuration. 

The system never achieves local equilibrium in any fixed sector of phase- 
space, but remains in an asymptotic out of equilibrium regime. 

We propose as a tool, both numerical and analytical, for the study of the 
out of equilibrium dynamics of spin-glass models the use of 'triangle relations' 
which describe the geometry of the configurations at three (long) different 
times. 



1 Introduction 



In the past years most of the study of spin-glass physics has been concentrated 
on the Gibbs-Boltzmann equihbrium measure. As a resuh of these efforts 
the mean-field theory is quite well understood [|T], |^. The picture that has 
emerged is one of a phase space with an extremely complex landscape with 
many minima separated by barriers, some of which are infinitely high. Such 
divergent barriers lead to ergodicity-breaking, a large system is not able to 
explore the phase-space in finite times. For low dimensionalities mean-field is 
not exact, and the situation is still controversial. In particular, the question 
of ergodicity breaking and the existence of many pure states is still not settled 

One of the most striking phenomena observed in the low temperature 
phase of real spin glasses is the aging effect ^ : the relaxation of the system 
depends on its history even after very long times. Though aging effects seem 
unusual from the thermodynamical point of view, they have been observed in 
numerous disordered systems, e.g. in the mechanical properties of amorphous 
polymers [0 , in the magnetic properties of high temperature superconductors 
[§], etc. The aging regime is an essentially out of equilibrium regime and 
therefore one has to face the dynamical problem in order to understand most 
experiments; the study of the Gibbs-Boltzmann weight yields only partial 
information. 

Several phenomenological models have been proposed to account for aging 
effects in spin glasses 0. In particular, a scenario for the basic mechanism of 
aging to which we shall refer below has been proposed by Bouchaud in Ref. 



[ p!0|] (see also the early work of Ref. |jTTl). The main idea is that of 'weak 
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ergodicity breaking', i.e. the system is not allowed to access different ergodic 
components but the relaxation takes place in a rough landscape with 'traps' 
and the distribution of the 'trapping times' does not have an upper bound. 

Still one would like to have a satisfying microscopic description of the 
dynamics of spin glasses and in particular of the effects mentioned above. In 
this respect there are, on the one hand, some numerical simulations of real- 
istic systems [0, |l^ that yield results in good agreement with experiments. 
On the other hand, the analytical understanding of the out of equilibrium 
relaxation in the thermodynamic limit, is much less developed than that of 
the Gibbs-Boltzmann measure; it is only recently that attention has been 
paid to this problem. 

In Ref. [0 it was pointed out that mean-field models exhibit a rich 
phenomenology in the out of equilibrium dynamics, qualitatively similar to 
those of realistic models and experiments, and some analytical results were 
obtained for a simple model, namely the p-spin spherical model. One sug- 
gestion of that work is that the out of equilibrium dynamics of mean-field 
models can be (at least partially) solvable analytically. The reason for this 
is the weakness of the long-term memory: the system remembers all its past 
but in an averaged way, short-time details tend to be washed away by the 
evolution. Later, numerical analysis has shown that also the more standard 
Sherrington-Kirkpatrick (SK) model captures the essential features of aging 
phenomena |jl5|]. Besides, Franz and Mezard have studied the out of equi- 
librium relaxational dynamics of a particle in a random potential in infinite 
dimensions. They have numerically solved the closed set of mean-field causal 
equations and have obtained with great precision results that are consistent 
with the picture we shall assume here [0. 

Some years ago, Sompolinsky and Zippelius introduced a dynamical for- 
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malism for mean-field spin glasses and used it to study the relaxation within 
an equilibrium state of the SK model |T7]. Later, Sompolinsky proposed to 
study the equilibrium (Gibbs-Boltzmann measure) of spin-glasses by consid- 
ering a relaxational dynamics after a very long equilibration time and for 
large but finite |]18|. The finiteness of guarantees ergodicity by allowing 
for the penetration of barriers that diverge in the large limit. The exis- 
tence of divergent barriers led Sompolinsky to postulate a hierarchical set of 
time scales which were taken as large and eventually went to infinity with 
N. 

However, in a true experimental situation the system is macroscopic and 
it does not reach equilibrium even for very long times. Thus, in order to 
make contact with the observations, we shall study the relaxational dynam- 
ics starting from a random configuration in the thermodynamic limit, i.e. 
making infinite from the outset. We shall concentrate on the asymptotics 
for large times, but throughout this paper we shall understand 'large' as 
t ^ oo after N —>■ oo (the opposite order to that considered by Sompolin- 
sky). Under these circumstances, the mean- field dynamical equations hold 
rigorously and the solution is unique (if one considers the opposite order of 
the limits, then one has to consider multiple solutions, just as in a system 
with instantons [|19[] ). 

Having already set A^ — >■ oo, the mean- field equations of motion have 
no parameters that become infinite, and a priori there are no time scales 
that go to infinity with an external parameter. However, the solutions to 
the mean-field equations of motion may exhibit infinite time scales under the 
conditions of weak ergodicity breaking. In this scenario the landcape has, 
within an ergodic component, finite barriers of all heights. The divergent 
barriers are within this framework unsurmountable by hypothesis. As the 
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system ages, it becomes more and more trapped, and it faces larger and larger 
barriers, simply because it has already crossed the smaller ones and it has 
had more time to find more 'trapping' traps. In other words an older system 
'sees' a more rugged landscape, of course not because the actual landscape 
has changed with time, but because of simple probabilistic reasons. The fact 
that there is no upper limit to the size of the finite barriers makes it possible 
for this process never to stop, and the system never to reach equihbrium. 

Consider a two-time function, for example the autocorrelation function 
C{tw + t,tw). The preceding discussion suggests that the behaviour of the 
relaxation of the correlation function in terms of t is affected by the overall 
'age' tu,- Indeed, it turns out that the 'age' tw automatically plays a very 
similar role to the one played by N in the Sompolinsky dynamics: it controls 
the height of the barriers that are relevant at such times. After a very large 
time tw, the system has gotten itself very trapped, and any subsequent motion 
(apart from a fast relaxation inside a trap) takes times that blow-up with t^j- 
It is at this point clear that if the age of the system is what drives the time 
scales, then it is essential that the correlation function be non-homogeneous 
in time {i.e. not a function of t exclusively). 

Having not made the assumption of homogeneity in time we shall ob- 
tain that there is no time t^q such that for all ti > t2 > t^q the two-time 
(^1,^2) functions {e.g. correlation and response functions) obey the equilib- 
rium relations, Fluctuation-Dissipation Theorem (FDT) and homogeneity. 
This means that the system does not reach equilibrium, not only in the (ex- 
pected) sense of not reaching the Gibbs-Boltzmann distribution, but in the 
wider sense of not reaching any time-independent distribution in a fixed re- 
stricted sector of phase space. In other words the dynamics is for all times 
something different from local equilibrium. 
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One consequence of these assumptions is that for an infinite system that 
is rapidly quenched below the critical temperature there is no way to fur- 
ther change the external parameters slower than the internal dynamics of 
the system, there being no upper time scale. The question of adiabaticity 
becomes subtle at precisely the critical temperature, where the upper time 
scales change from finite to infinite. One expects that what happens in the 
adiabatic cooling of an infinite system across the transition temperature is 
dependent of the nature of the dynamical phase transition. 

In short, we shall here analyze the out of equilibrium dynamics of the 
SK model basically inspired by the previous results obtained for the simpler 
p-spin spherical model the numerical simulations of Ref. [|15|, and the 
phenomenological picture of Bouchaud Wl 



The outline of the paper is as follows. In Section ^ we review the SK 
model and its relaxational dynamics. In Section |^ we present the assump- 
tions of weak ergodicity breaking and weak long-term memory on which the 
subsequent treatment is based. In Section || we discuss the asymptotic equa- 
tions and their invariances and make two further assumptions suggested by 
these invariances. Section ^ is devoted to rather general properties of the 
geometry of the triangles determined by the configuration at three different 
times and to the discussion of the 'correlation scales'. This last discussion is 
not particular to the SK model. In Sections |^ and |^ we construct the solution 
to the asymptotic equations. 

The results of this paper are by no means exhaustive, though they have a 
few consequences that can be verified numerically and that are expressed in 
terms of experimentally measurable quantites. Some of them are presented 
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in Section ^ where we also mention some results of Ref. [|T6| relevant to this 
discussion. In Section ^ we give a qualitative description of our results and 
contrast them with those previously found in Ref. [|T^] for the p-spin spherical 
model. Finally in the conclusions we summarise our results, we discuss the 
relationship with Sompolinsky dynamics and we point out some of the many 
open problems. 



2 The relaxational dynamics of the SK model 

The SK Hamiltonian is H = — Y,i<j JijSiSj where the interaction strenghts 
Jij are independent random variables with a Gaussian distribution with zero 
mean and variance Jfj = 1/ (2A^). The overline stands for the average over the 
couplings. The spin variables take values ±1. For convenience we consider a 
soft-spin version 

N 1 ^ 

H = -Y1 -hsiSj + a - 1)^ + Yl K-irSh ■■■Si, , (2.1) 

i<j i ii<...<ir 

— oo < Si < oo, \fi. Letting a — oo one recovers the Ising case, although 
this is not essential. Additional source terms {hi^ i^. time-independent) have 
been included; if r = 1 the usual coupling to a magnetic field hi is recovered. 
The relaxational dynamics is given by the Langevin equation 

T,'dMt) = -P^.+m^ (2.2) 

OSi{t) 

^i{t) is a Gaussian white noise with zero mean and variance 2ro. The mean 
over the thermal noise is hereafter represented by ( ■ ). 

The mean-field sample-averaged dynamics for — oo is entirely de- 
scribed by the evolution of the two-time correlation and the linear response 
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functions IIT 



1 



N 



i=l 



Following Ref. |T3], let us introduce the generalized susceptibilities 



Fit) ^ lim ^ V ^^^■■■sUt)> 



ll<...<lr 



h=0 



= r / dt'C''-\t,t')G{t,t') 
Jo 

and their generating function Pd{q) 



(2.3) 



lim lim 

t—^co N^oo 



J\fr ^ 

i\<...<ir 



d< Si^t) . . . Si,.{t) > 



h=0. 



(2.4) 

The interest of the function Pd{q') is that if a system reaches equilibrium 
within a fixed restricted sector of phase space then it is easy to show that 
Pd{q') should be just a delta function. We shall see that this happens only 
for T > T,. 



3 Weak Ergodicity Breaking 



As in Ref. [14|, we shall make the following two assumptions, supported by 



the numerical simulations of this model 15 



i. 'Weak' ergodicity-breaking: 

lim C(t,t') = V fixed t' 
7 



(3.1) 



This means that the system, after a given time t', starts drifting away (albeit 
slowly) until it reaches for sufficiently large times t the maximal distance 
C = (see section |]). 

This statement has to be slightly modified in the presence of a magnetic 
field; in that case '0' has to be substituted by the maximum distance com- 
patible with the remanent magnetization. In particular this implies that the 
remanent magnetization C{t,0) tends to zero in the absence of a magnetic 



x{t, t') is the normalized (linear) response at time t to a constant small mag- 
netic field applied from t' = up to t' = t', often called the 'thermoremanent 
magnetization' (see section ||). 

This hypothesis is quite crucial, since the response function represents the 
memory the system has of what happend at previous times: the weakness 
of the long-term memory implies that the system responds to its past in an 
averaged way, the details of what takes place during a finite time tend to be 
washed away. 

in. Finally, we shall make the usual hypothesis that after a (long) time 
t' there is a quick relaxation in a 'short' time t — f to some value q, followed 
by a slower drift away. The parameter q is interpreted in the Sompolinsky- 
Zippelius dynamics as the Edwards- Anderson parameter for a state |jT^. Here 
the word 'state' certainly does not apply (since a true state is a separate 



field. 



ii. 'Weak' long-term memory: 




V fixed t' . 



(3.2) 
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ergodic component) but we may picture q as the size of a 'trap' or the 'width 
of a channel'. Within these traps the system is fully ergodic while it becomes 
more and more difficult to escape a trap as time passes. The correlation and 
response functions are thus written in a way that explicitly separates the 
terms corresponding to the relaxation within a trap: 

C{t,t') = CFDT{t,t')+C{t,t') , 
G{t,t') = GFDT{t,t')+QitX) . 

Consistently, CpDrit^t') and GpDTit,t') are assumed to satisfy the equilib- 
rium relations, i. e. time homogeneity and the fluctuation-dissipation theorem 
(FDT) 

GFDT{t,t') = CFDT{t-t') „ . dGFDTit-t') 

^FDT[t — t ) 



GFDT{t,t') = GpnAt-t') ^'""'^^ dV ' 

and 

Cfdt{^) = l-q, \imt-t'^ooGFDT{t-t') = 0, 

C{t,t) = q, limj_ooC(t,t') = 0. 

The equilibrium dynamics within a state has been solved with these as- 
sumptions [|T^. Since this calculation remains the same for the out of equi- 



librium dynamics, although the 'state' must be reinterpreted as a 'trap', we 
shall not discuss it in this work. We shall concentrate on the evolution of 
the long-time functions C and Q and furthermore we shall restrict ourselves 
to the dynamics of the model at a temperature near and below the critical, 
T = Tr — T with r small. 



4 Asymptotic Equations 

The full dynamical equations have been written down by Sompolinsky and 
Zippelius |]T^. They are rather cumbersome because, just as in the static 
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case, the spin variables cannot be explicitly integrated away. 

Under the assumptions made in the preceding section, viz weak ergodicity 
breaking and weak long term memory, one can find equations for the evolu- 
tion of C and Q valid asymptotically for large times t > t' near the transition. 
They have been presented in Ref. and they correspond to the dynami- 



cal counterpart of the 'truncated model', the statics of which was solved by 
Parisi |jl|] . (The derivation can be done in a way that makes clear the contact 
with the static free-energy functional near Tc by writing the dynamics in the 



super symmetric notation ||2T|, |22[). In the absence of a magnetic field the 
equations read 

2iT-q)Cit,t')+yC'it,t')+ f dt" C{t,t")G{t',t") 

Jo 

+ f dt" g{t,t")C{t',t")+ f dt" g{t,t")c{t",t') = 0, 

JO Jt' 

(4.1) 

2{r-q)g{t,t')+ f dt" g{t,t")g{t",t') + 3yc\t,t')g{t,t') = 0, 

Jt' 

(4.2) 

y = 2/3. In these equations causality is assumed 

g{t,t') = for t < t' . (4.3) 

These equations do not contain derivatives with respect to time; they have 
been neglected following the assumption of slow variation of C and g for long 
times. 

Evaluating eq. ( |4.2| ) in t = t' implies either g{t,t) = (corresponding to 
the high temperature regime) or 

2(r -q)+ 3yq^ = . (4.4) 
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From here follows the value of the Edwards-Anderson parameter which is 
also obtained in the static treatment |T|. 

Even if the eqs. ( |4.1| ) and ( [4 .21 ) are non-local, they can be interpreted as 
asymptotic if the crucial assumption of weakness of the long-term memory 
is made: eq. (|3.2| ) implies that the lower limit t" = in integrals such as 

f dt" C{t,t")g{t',t") (4.5) 
Jo 

can be substituted by any lower limit t" = to, and this has no effect in the 
integral as long as t and t' both go to infinity. 

As has been often noted the asymptotic equations for C and Q have an 



infinite set of invariances [0,|TT],[^. Indeed, if we perform an arbitrary 
reparametrization of time: 

i = h(t) , i' = hit') (4.6) 

with h an increasing function, and we redefine 

C{t,i') = C{h{t),h{t')) , G{i,i') = h'it') G{h{t),h{t')) , (4.7) 

the transformed functions C, G satisfy the same equations in terms of the 
reparametrized times. This means that given one solution we can obtain 
infinitely many others by reparametrizations. 

This invariance is a consequence of having neglected the time derivatives 
in making the asymptotic limit. The full dynamical equations have no such 
invariances; because of causality their solution is unique. The best we can 
do with eqs. ([4.1|) and ( [4.2|) is to find a family of asymptotic solutions 
(related by reparametrizations). Which one is actually the correct (unique) 
asymptote can only be decided from equations that do not neglect time 
derivatives. Throughout this work we shall try to go as far as possible keeping 



11 



the discussion at the reparametrization invariant level: we shall only obtain 
solutions modulo reparametrizations (however, the relaxation within a trap, 
as solved in Ref. is well determined and not affected by this invariance). 
Having this in mind we shall make the following two further assumptions: 



iv. C and Q are related by a reparametrization invariant formula. This 
can only be fulfilled by 

g{t, t') = x[c{t, t')] ^^M) - 1') (4.8) 

where X depends on the times only through C. Indeed, under reparametriza- 
tions ( [4.6|) and (|4.7] ) this equation transforms into 

G{i i') = x[c{i, i')] ^^M) e{i - i') (4.9) 

i.e. it retains the same form. 

Furthermore, if we supplement the definition of X[z\ with X[z\ = 1 for 
q < z <1 then the relation ( ^ holds for all C{t,t'), t' large (c/eq. (^). 
X[z] may be discontinuous in z = q, where it jumps from X[q] to 1. 

An immediate consequence of eq. (|4.8| ) is that all generalized susceptibil- 
ities ( p.3|) are given by 

r{t) = {l-q^)+ rX[q']d{q^). (4.10) 
Jo 

Hence the dynamical generating function of the generalized suceptibilities 
Pd{(l) (eq. ( ^.41 ) ) and in particular the asymptotic energy are entirely deter- 
mined by the function X[z] and q. 

V. Given three large times tmin < tint < tmax, the corresponding three 
configurations s{tmax), s(tmt)) s(tmm) define a triangle the sides of which are 
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given by the three correlations C{tint,tmin), C{traax,tmin), C{tmax,Unt)- For 
the three times tending to infinity we propose that the correlation between 
the extreme times C(tmax, tmin) is completely determined by the correlations 
between the extreme times and any intermediate time: 

C {t-rnaxi tmin ) = mt max) l^int 

),C{t 

int) tmin)\ • 

(4.11) 

In other words, we are assuming that when tmin ~^ oo the correlation 
C{tmax,tmin) Only depends on tmin and tmax through the other two corre- 
lations. The relation / is not necessarily smooth and we shall see in the 
following sections that in fact it is not. We can formally invert this equation 
by defining the inverse function / [| 

C {tint J tmin) /{C (tmax j tint) : C (tmax j tmin)^ ■ (^■-^^) 



We are proposing relation ( f4.11| ) for the whole range of values of C, including 
the FDT sector. 

Both assumptions made in this section are amenable to numerical checks 
and we shall discuss them in detail in Section H. 



5 Triangle Relations 

In this section we shall study the properties of the function /, defined in 



eq. (|4.11|). A priori f has no reason to be smooth, though we shall assume 



throughout that it is continuous. All the results we shall present in this 



^Note that in the definition of / the smallest argument is always on the right 
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section are general, they do not depend on any particular model but just 
follow from assumption v. {cf. eq. ( [4.11| )). 



5.1 Basic Properties 

The first trivial properties are 

f{x,l) = f{l,x) = x (5.1.1) 

which are obtained choosing tint = tmin and tint = tmax, respectively. 

Since we are assuming that the system drifts away at any time, namely 
assumption i., 



f{a,y) > f{b,y) if a > b, 

f{y,a) > f{y,b) if a > b. 



In particular for any (a, b), 



/(a,l) = a > f{a,b) 
f{l,b) = b > f{a,b) 



(5.1.2) 



(5.1.3) 



and this implies 

/(a, 6) < min(a,6) . (5.1.4) 
Consider now four successive times ti < t2 < ^3 < ^4- We have 

C(t4,ti) = f[C{t,,ts),C{ts,t,)] 

= f[Cit,,t2),Cit2,t,)] 

= f[Cit,,t,),f[Cit,,t2),Cit2,t^)]] 

= f[f[Cit,,t,),Cit,,t2)],Cit2,t,)]], (5.1.5) 

i.e. f is associative. 

The existence of a neutral (eq. (|5.1.1| )) and the requirement of associativity 
severely restricts the choice of the function /. 

14 



Two important examples of functions (the first one not smooth, the sec- 
ond one smooth) satisfying eqs. ( p.l.l| ), ( |5.1.2| ) and ( |5.1.5| ) are: 



/(a, 6) = min(a, 6) , (5.1.6) 
the ultrametric relation, and 

f{a,b) = ab. (5.1.7) 

One can check that this last relation corresponds to the vector s evolving 
in such a way that the direction of the trajectory at two times is uncorrelated: 
i.e. which spin flips at a given time is independent of which ones flipped 
before. The spherical triangle determined by s(tmin), s(tint) and s(tmax) is 
then, for probabilistic reasons, right-angled. 

As an example of the physical meaning of the function /, consider the 
slight variation of eq. ( |5.1.7] ) which was found in for the long-time 
correlations C of the p-spin spherical model 

intitmin) dtmaxitint) /- ^ q\ 

q q q ' 

This can be understood if one defines the 'magnetization' vector for large 
times t as 

m^it) = ^^ dTsiit + T) (5.1.9) 
A Jo 

(A oo, A/t 0). Then a short computation shows that (1/A^) I^j mf — ^ q 
and C(t,t')/q is the cosine of the angle subtended by m(t) and m(t') at 
two widely separated times {t — t' » A). Then eq. ( p. 1.8] ) says that the 
magnetization vector m{t) describes a trajectory without memory of the 
direction, and hence makes right angled triangles in any three large (and 
widely separated) times. 
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5.2 Correlation scales 



Consider now the function f{a,a) satisfying (c/. eqs. ( |5.1.2|) ) 



/(a, a) < a . 



(5.2.1) 



The above inequahty admits fixed points al such that f{al, al) = a^. These 
points can be isolated or they can form a dense set. In fig. 1 we sketch a 
possible function /(a, a). 

Take now a succession of (large) times to < < ••• < such that the 
correlation between two succesive times is C(tj+i,tj) = b, and compute the 
correlation C{tr,tQ) between the two extremes of the succession 



The function / is iterated (r) times and the order of parenthesis is immaterial 
because of associativity. Choose two correlation values corresponding to 
consecutive fixed points, say al > (see fig. 1), with no other fixed points 
in between. Then, it is easy to see that given two values bi, 62 with al > bi > 
62 > 5 there exists a finite number (s) such that 



i.e. with a finite number of steps (iterations of /) with correlation bi we can 
go up to or beyond 62- In contrast, if we consider a succession of steps each 
of correlation a* {a* any fixed point), the correlation between the extremes 
never goes beyond a* for finite (s). 

This suggests that we define in a reparametrization-invariant way a cor- 
relation scale as the set of correlations that can be connected by relation 
( 5.2.3|) for some finite (s). This breaks the whole interval of correlations into 
equivalence classes. 



b^^^^C{tr,to)=fib,-fib,f{b,b))...). 



(5.2.2) 




(5.2.3) 
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With this definition a fixed point a* constitutes a correlation scale in 
itself. An interval which is made of a dense set of fixed points such as {a^, al) 
in fig. 1 is then a dense set of scales. 

The interval of correlations (none of them a fixed point of /(a, a)) con- 
tained between two fixed points is a correlation scale which we shall call 
'discrete'. 

Note that the time difference (tj+i — ti) needed to achieve a certain cor- 
relation is not independent of the time ti, but we can suppose that it does 
not decrease with time, i.e. 

C{ti^i,ti) = C{ti,ti_i) =^ ti^i ~ ti > ti — ti-i . (5.2.4) 

Then the above definition of correlation scales translates into a definition of 
'infinite time-scales'. 

5.3 Ultrametric relations 

Let us start by showing that the relation between fixed points is ultrametric. 

Let al, 02 be any two fixed points with al > 

a*2 = f{a*,a*2) < f{a*2,al) < a*, 
al = f{a*,a*2) < /(a^a^) < a*, 

we have here used eqs. ( p. 1.21 ) and ( p. 1.4] ). Hence, for any two fixed points 

/(a*, al) = f{al, al) = mm{al, a^) (5.3.1) 

and ultrametricity holds. 

Next, we consider a discrete scale limited by a* and a*^^, two consecutive 

fixed points, and a number b such that a* > b > We assume that / is 

a smooth function of x, y within the scale. Then, one has (see Appendix A): 

fialb) = f{b,a*) = b Wbe{a*^„a*), 
/(a*+i,&) = /(fe,a*+i) = a*+i V 6 G (a*+i, a*) , 
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i.e. a* acts as the neutral and a*^i as the 'zero' inside the scale. 

Consider now two different scales limited respectively by a* > a*_^_i and 
al > al^^. Using the previous result we now show that the relation 62) 
between two correlations belonging to each scale a* > 61 > a*^^ and al > 
^2 > Ofc+i is ultrametric: 

h2) = /(62, 61) = min(6i, 62) . (5.3.2) 
Let us start by choosing hi = a*_^^ and a*_^i > al then 

/(/(62, aD, a*+i) = /(62, a^+J = /(62, /(a^ a*^,)) = /(62, 4) = &2 ■ (5.3.3) 
Hence 

/(62,a*+i) = 62, (5.3.4) 

and similarly 

/(a*+„62) = 62. (5.3.5) 
Now choose 61 satisfying a*^^ < h < a*, then 

f{b2, h) = f{f{b2, al), h) = f{b2, f{al, 61)) = /(62, 4) = &2 . (5.3.6) 
Hence 

f{b2,bi) = b2, (5.3.7) 

and similarly 

/(&i,&2) = &2. (5.3.8) 

Within a scale ultrametricity does not hold but if we assume that / is 
there smooth it is then a one dimensional formal group law and we have for 
bi, 62 within the /cth-scale that f{bi, 62) is of the form 

fibi,b2)=j^%ib,)-jkib2)] (5.3.9) 
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for some function jk{x) which can be different for each scale. This is a well- 
known result from formal group theory and we present it in Appendix 
B. 

Furthermore, this implies that within a scale (see eq. (|B.1CI|) ) 



for some increasing function hk{x) ( Appendix B). The solution in Ref. [|I4 



corresponds to only one discrete scale (apart from the FDT scale), and has 
the form of eq. ( p.3.10| ). 



6 Dynamical equations 

In this section we shall study the asymptotic dynamical equations of the SK 
model (eqs. ([4.1|) and ([4.2|)). We shall start by simplifying the equations 



using assumption iv. 

Let us define two functionals 

F[C] = - dC X[C'] , (6.1) 

H\C] = - J' dC C'^X[C'] . (6.2) 

Note that even if X may be discontinuous, F and H are continuous. Thus 
inserting eq. (^]8|) in eqs. ( ^?1| ) and ( [4.2[ ) we get 

...... ^„,dF[cit',n] 



3yq^C(t,t')+yC%t,t')+ ( dt" C(t,t" 

Jo 



dt" 

(6.3) 
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,dF[Cit,t')] , ft ^.,dF[C{t,t")]dF[C{t",t')] , ^ dH[C{t,t')] 



at' A' at" at' ^ at' 

(6.4) 

This last equation can be integrated once w.r.t. t' to give 

-3yg2F[C(t,t')]+ jl dt" ^^Bll^F[Cit",t')] + 3yH[C{t,t')] = . (6.5) 

We now have two reparametrization invariant equations for C{t,t') which 
have to be satisfied simultaneously. Eqs. ( |6.3|) and (|6.5| ) can be written 
in a form in which the times disappear using assumption v. Indeed, with 
definition ( [4.12|) they formally become 

-3yq'C+ f dC X[C']f{C,C') - f dC F[f{C,C')] 
Jo Jo 

+ r dC X[C']f{C',C) + yC^ = 0, (6.6) 
Jc 

-3yq'F[C] + dC X[C']F[f{C\C)] + 3y H[C] = , (6.7) 

since f{C,C') is not necessarily a well-behaved function on the whole inter- 
val [0, 1] we shall take care of this point in the next subsection. Eqs. ( |6.6| ) 
and ( |6.7| ) together determine X[C] and f{C,C'). Having eliminated the ex- 
plicit time dependence, we have effectively divided by the reparametrization 
group. In what follows we shall concentrate on studying the solution to these 
equations. 

6.1 Equations within a discrete scale 

Let us take C belonging to a discrete scale, C G (03, a*). Due to the ultra- 
metricity between different scales (c/. eq. ( |5.3.2| )) we can use 



fiC,C')=C', (6.1.1) 
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when C is outside the scale of C. This allows to simplify eqs. ( |6.6| ) and ( |6.7| ) 
and furthermore to deal with a region where the function f{C, C) is smooth. 
In these regions f{C,C') can be written as (see Appendix B) 

f(C,C')=J-'[j^^ forC>C' (6.1.2) 
and since j(a*) = 1 

f{alC)=C. (6.1.3) 
Therefore the equations become 

- 3yq^C + a*F\al] - CFlal] + yC^ - 2 H dC F[C'] 

Jo 

+ f dC X[C']f{C,C') ~ f dC F[f{C,C')]+ r dC X[C']f{C',C) = 

(6.1.4) 

-3yq'F[C] + 3yH[C] - F[C]F[al] + T dC X[C']F[f{C',C)] = 

Jc 

(6.1.5) 

Evaluating eq. ( |6.1.5| ) in C = al and C = 03 respectively we have 



3yH[al] = F[at](F[at] + Syg^) , (6.1.6) 
3yH[a;] = F[a*]{F[a*] + 3yq^) . (6.1.7) 



Moreover differentiating eq. ( |6.1.5|) w.r.t. C and evaluating in C = a* we 
obtain 

X[al]{-3yq^ - 2F[al] + 3yaf) = , (6.1.8) 
and this implies X[a*] = or 

F[al] = ^iaf-q'). (6.1.9) 
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Differenting twice eq. ( |6.1.5| ) w.r.t. C and evaluating in C = a* we have 



X[al] 6yal - X[al 



.1 dfiC',C) 



dC 



. 



(6.1.10) 



C'=C=a*, 



The derivative on the right can be calculated using eq. (|6.1.2|) and is equal 
to one. Then if X[a*] ^ 

X[a{] = 6yal . (6.1.11) 



6.2 X within a discrete scale 

We shall assume that 

vi. X is a non decreasing function. 
Under this last assumption, we shall show that X is constant within a discrete 
scale 

Differentiating eqs. (|6.1.4| ) and (|6.1.5|) w.r.t. C, multiplying the first one 
by X[C] and subtracting, we obtain 

'rfC'X[C]^£^ (X[/(C,C')] - X[C'] 



.ndfiC',C) 



+ 4 dC'XlC'^ 



{x[f{C\C)]-X[C]) = 0.(6.2.1) 



Since this equation is valid within any scale, we see that a sufficient condition 
for eqs. ( |6.1.4D and ( |6.1.5| ) to be compatible is that X be constant within 
each scale. Let us now show that if X is non-decreasing this is the only 
possibility. Differentiating eq. ( p. 2.1 ) w.r.t. C and then evaluating in C = 
yields 



X[al] 



a, [ dC 



x'[y] 



. 



(6.2.2) 



C=al 



This equation admits the solution X[a^] = which corresponds to the high 
temperature phase. If this is not the case, and assuming that X'[z] > 0, the 
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integrand should vanish. The squared factor looks like 



dfiCC) 



dC 



C=a* 



V Jin 



de{z) 



dz 



'd£{C') 
dC 



(see Appendix B) and does not vanish for C > Thus, 

X'[y] = X[y]= X constant 

for y G {a2,al). Hence, using eq. (|6.1.11|) 



X[y]=X = 6yal. 



(6.2.3) 



(6.2.4) 



(6.2.5) 



6.3 No discrete scales 



Let us show that the discrete scales collapse. Using that X is constant within 
the discrete scale, we have 



F[a; 
H\a* 



F[al]+X{al 
H[al] + —{af-af) . 



Putting this into eqs. ( |6.1.6| ) and ( |6.1.7| ) and using eq. ( |6.1.9| ) 

{al-alf[y{al + 2al)~X] = Q. 



(6.3.1) 
(6.3.2) 

(6.3.3) 



This equation gives as one possible root 03 = 4a J, which is not acceptable 
since by hj^othesis a*2< a\. Hence we are left with 

al = al (6.3.4) 

and this imphes that each discrete scale is indeed empty. 

Having shown that there are no discrete scales (except for the FDT scale, 
which is not contained in the previous equations), one sees that the solution 
should verify ultrametricity for all values of the correlations C. 
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7 Ultrametric Solution 



Let us now describe in detail the ultrametric solution: for tmin — ^ oo, 

C {traaxi tmin) ^^^^(^C (tmaxy tint) y C(tinty tmin)) if C (tmaxy tmin) ^ Q ('^■-^) 

and if C{tmax,tmin) > Q the solution of Sompolinsky-Zippelius holds. 

In the preceding section we have concluded that we have a dense set of 
scales, so that 

fiC,C')=C' (7.2) 
VC < C. Thus eqs. ( p. 61 ) and ( |6.7| ) simplify to 

-Syq'^C -CF[C]+yC^ + dC'C X[C']- dC F[C'] = 0, (7.3) 

Jo Jo 

-3yq'F[C]-iF[C])' + 3yH[C] = 0, (7.4) 



and from here follows that eqs. (|6.1.6|) and (|6.1.9|) hold for every value C < q: 



3yH[C] = F[C]{F[C]+3yq') , 

F[C] = ^{C'-q'). (7.5) 

Differentiating eq. ( [7. 51) w.r.t. C we obtain: 

X{C) = 3yC . (7.6) 

This yields for P^iq) {cf. eqs. (^, (^) and ( PD] )) 

P4q') = (1 - X[g']) 5(g' - g) + 3yU{q') , (7.7) 

where f/(q'') = 1 if < g' < g, and zero otherwise. The value of q is given by 
eq. ( [4.4|) . Hence, we have found that 

Pdiq') = P{q') (7.8) 
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for the SK model where P{q') is the Parisi functional order parameter as- 
sociated with the Gibbs-Boltzmann measure [Q, also implying that the dy- 
namical and statical transition temperatures coincide. This equality is not 
obvious, and is a property of this particular model. Indeed, this same dy- 
namics yields for the model of Ref. fl^ a dynamical Pd{(i) which is different 



from the static one. For the SK model the energy and susceptibility to lead- 
ing order in N coincide with the corresponding equilibrium values, and the 
size of the 'traps' encountered for large times coincides with the size of the 
equilibrium states. 

In particular, ultrametricity implies that a plot of C(t,t') vs. t' tends to 
have a long plateau. More precisely, consider the function 

Cifi) = lim C(t,/it) . (7.9) 

t — >oo 



It is easy to see that eq. (7J.) implies that C(/i) drops from one to a certain 
value g (0 < g < g) in a small neighbourhood of fi = 1, remains constant 
and equal to q in the interval (0, 1) and drops from q to zero in a small 
neighbourhood of /i = 0. The actual value of q cannot be determined unless 
one goes beyond the reparametrization invariant results. This last result was 
verified in ref. [1161 for the model studied there. 



8 Simulations and Measurable Results 



In this section we discuss some consequences of the assumptions and deriva- 
tions of the previous sections that can be checked with numerical simulations. 
Some of these involve magnitudes that are measurable experimentally; for a 
toy model such as the SK this is not such an advantage, but it would be if 
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some of these results turn out to hold also for finite-dimensional systems. 

Our results have been obtained in the thermodynamic limit for asymptotic 
times, limj^oo after lim^v-^oo- In a simulation this means that one has to 
eliminate finite-size effects. 

Firstly, the two initial assumptions i. and ii. have been already observed 
in Ref. |jl5| where the out of equilibrium dynamics of the hypercube spin 
glass has been studied numerically. This model is expected to reproduce for 
high dimensionalities the SK model |2^, |26[| . 

Assumption ^., weak ergodicity breaking, has been verified by plotting the 
correlation function C{t + ty,, t^) vs. t in a log-log plot for different waiting 
times tw (Fig. 3 in Ref. Furthermore, numerical simulations of the 

3D Edwards-Anderson model also support this assumption in that realistic 
model 0. 

Assumption ii., weakness of the long-term memory, or equivalently the 
decaying to zero of the thermoremanent magnetization, has also been verified 
(Fig. 2 of Ref. |T3[). A similar behaviour has been obtained both for realistic 
models |]T2| and experimentally ^. 

Secondly, as a consequence of eq. ( [4.8|) the response x(^) tw) introduced 
in eq. (|3.2| ) is given by 

X{t,t^)= / dq' X[q']=F[C{t,t^)]-F[0] = F[C{t,t^)]. (8.1) 

Jo 

Hence, for large enough times t and t^, the times [t, ty^) enter parametrically 
in a plot xitytw) vs. C{t,tw) and all the points obtained for different pairs 
{t,tyj) should lie on a single universal curve, the integral function F of X. 

The plot x(t,t^) vs. C(t,tw) for the hypercubic cell of dimension D = 
15 at temperature T = 0.2 is shown in Fig. 2, together with the second 
integral of the static P{q') evaluated in C{t, t^) for the SK model. The curves 
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for different roughly coincide; the departure is not systematic w.r.t. tw 
However, they do not coincide with the corresponding static curve for the SK 
model at that temperature. This could be an effect of the finite dimension 
D, not inconsistent with the static results of ref. [^. It was here found that 



the function P{q') for small q' is is quite smaller for the hypercubic cell of 
dimension D = 12 than for the SK model. 

Thirdly, assumption iv. on the existence of the triangle relations and its 
implicancies can be tested numerically in the following way: 

a) choose a number C and a large number tw 

b) determine the time tmax such that C(tmax,tw)=C 

c) plot for all times t {tw < t < tmax) C(tmax,t) versus C(t,tw). 

d) repeat the procedure for a larger ty^ and the same C. 

The limiting curve, obtained as tw becomes larger, is the (implicit) function 
given by eq. 

C = f{x,y), (8.2) 

or 

y = f{xX). (8.3) 

If, as has been found in the previous sections, ultrametricity holds, then 
the area limited by the horizontal line x & [C,l], y = C, the vertical line 
X = C, y E [C, 1] and the curve constructed following the procedure above, 
would vanish when t^ oo. Studying the behaviour of this area is more 
practical than simply looking at the curves since its calculation involves many 
points and reduces the noise. In Fig. 3 we present the curves obtained in this 
way (n. 6 these curves have been smoothed using a local interpolation in order 
to better show the qualitative tendency, error bars of order ~ 0.01 should be 
taken into account). In the inset we include a log-log plot of the area vs. t^- 
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The approach of the curves to their hmit is very slow and this could raise the 
suspicion that this is a finite size effect. We have checked however that for 
a system four times smaller the decrease in area is not very different. The 
qualitative trend does not depend on the temperature; we have also checked 
these results for higher subcritical temperatures though we shall not present 
them here. Finally, note that the value of q (~ 0.92 for T = 0.2) is easily 
seen in the Figure. 

Because the correlation functions, even though easy to compute numer- 
ically, are hard to measure in an experimental system, it is convenient to 
have a relation involving only the easily measurable quantity x- Consider 
the function defined by 

xM=Hx{tX),x{t\t')). (8.4) 

From the preceding sections we have that 

T{x,y) = F[f{F-\xlF-^[y])], (8.5) 

so that if / is associative (commutative) then JF also is. Indeed, JF and / 
are isomorphic as a group law pSf, and all results quoted for the function / 
carry through to JF. In the ultrametric case, since F is a growing function, 
we have 

JF(a;, y) = min(x, y) . (8.6) 

Although the results of the present paper are in principle only valid for mean- 
field systems, we have not resisted the temptation to check this last relation 
with the experimental data for spin-glasses of 0, with negative results. The 
fuction x{t,t') for experimental systems follows an almost perfect t'/t law, 
and is in this sense rather more similar to a system with discrete scales. 
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A detailed analysis of the numerical solution of the mean-field dynamical 
equations corresponding to the relaxation of a particle in a random potential 
in infinite dimensions was carried out in Ref . |TB[ . In particular it is verified 
there that the results for large waiting times coincide to order with great 
precision with those of the static treatment. This coicidence is also found 
here for the SK model, but not in the p-spin spherical model (Ref. ||14|| ). 
The common element of the former two models is that the replica analysis of 
their statics involves an infinite number of breakings of the replica symmetry, 
while the j9-spin model has statically only one breaking and dynamically one 
discrete scale apart from the FDT scale. 



9 Discussion 



We are now in a position to discuss qualitatively the out of equilibrium 
dynamics of this model. 

The system first relaxes rather rapidly to an energy which is slightly above 
the equilibrium energy. In that region it starts encountering 'traps'. Within 
a trap the relaxation is rapid and described by the Sompolinsky-Zippelius 
dynamics ||17|| . 

As time passes, the energy relaxes slowly towards the equilibrium value, 
the 0{N) difference between the dynamical and equilibrium energy goes to 
zero. The actual states contributing to equilibrium have an energy differing 
by only 0(1) from the lowest state 0], and are not reached in finite times. 
However, their cousins the long-time traps resemble them in their geometry 
(value of q, relaxation within them), except that the barriers surrounding 
a true state are divergent, while those surrounding traps are finite, though 
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large. The evolution away from traps becomes slower and slower as time 
passes, so that traps encountered at longer times tend to resemble more and 
more the actual states contributing to equilibrium. 

The fact that the system relaxes to values that are equal to order 
to the equilibrium values (energy, Pd{q), etc.) and that the dynamical and 
static critical temperature coincide is not a general feature of spin-glass out of 
equilibrium dynamics, but a property of this model. A different situation has 



been found for the p-spin spherical model |T^, for which the non-equilibrium 
dynamics goes to a threshold level that is above (to 0{N)) the states that 
contribute to the Gibbs-Boltzmann measure (and hence Pd{(l) P{(l) aiid the 
asymptotic energy is different from the Gibbs-Boltzmann measure energy). 
The reason for this difference can be seen by considering the TAP approach. 
In the p-spin spherical model, all the TAP valleys below the threshold are 
separated by infinite barriers and have a positive-definite Hessian. The sys- 
tem would remain trapped within any of them, but it never does because it 
stays touring at the threshold energies above which there are no valleys and 
below which the barriers are 0{N), i.e. in the small range of free energies in 
which the barriers are 0(1). 

In the SK model there seems to be no threshold of this kind, in the sense 
that the TAP valleys of the free energy encountered above the equilibrium free 
energy should be separated by only 0(1) barriers. This is quite reasonable 
if one accepts that most of these solutions (unlike the ones of the p-spin 
spherical model) are 'born' by division of other solutions as the temperature 
is lowered and, moreover, their Hessian contains zero eigenvalues |27|. 

We also note that both the hypotheses of weak ergodicity breaking and of 
weakness of the long term memory can be understood within this scenario. 
Since no traps are true states, the system eventually drifts away forgetting 
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the characteristics of any given trap (and in particular its magnetization). 



10 Conclusions 



We have presented the relaxational dynamics of the SK model in the ther- 
modynamic limit in a way that naturally involves an asymptotic out of equi- 
librium regime and aging effects. We have restricted ourselves to a situation 
in which the system is rapidly cooled to a sub-critical temperature and every 
external parameter is afterwards left constant, as in some experimental set- 
tings. A different approach to the dynamics is to consider explicitly changes 
in the external parameters such as the temperature 

We have shown that the asymptotic dynamical equations can be solved 
under mild assumptions which we have tried to state as explicitly as possible. 
Since we are not allowing for the crossing of infinite barriers all the assump- 
tions can be checked numerically with relatively small computer times and we 
have presented preliminary results in this direction. We have derived a set of 
equations containing only the correlation function and the relation between 
three correlations (triangle relation) and we have found that the unique solu- 
tion to these equations implies ultrametricity for every three widely separated 
times. Without the assumption of time homogeneity and in the absence of 
any parameter controlling the scales, it is not a priori obvious how to define 
these scales. We have given a precise definition of correlation scales, which 
can be applied to other models. 

The present treatment has important common elements with both the 
static replica analysis and the dynamics a la Sompolinsky. 

As regards the former this is due to an underlying formal algebraic sim- 
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ilarity between the replica treatment and the asymptotic dynamics. Quite 
generally the asymptotic dynamical equations can be derived using this sim- 
ilarity and their solution has a connection with the replica solution with an 
ansatz a la Parisi (although this does not necessary mean that the statics 
and asymptotic dynamics should give the same results for every model) [p^] . 

It is worthwhile discussing in more detail the similarities and differ- 
ences with Sompolinsky's dynamics. In that framework, one assumes time- 
homogeneity plus a relation like ( [4.8|) between the correlation and response 
functions. Then one further assumes that the correlation function relaxes 
(ever more slowly) to zero for widely separated times (in the absence of a 
magnetic field). With these assumptions one hopes to have a representation 
of the equilibrium dynamics after an infinite waiting time and for large but 
finite N. 

A well-known problem of this picture is that the decaying to zero of 
the correlations is incompatible with the equilibrium solution |^ unless one 
considers multiple dynamical solutions for times long enough as to allow for 
infinite-barrier crossing |T^. Moreover, there is an additional puzzle: the 
hypothesis of time homogeneity applied to the p-spin spherical model fails to 
give the equilibrium values . 

After the work of Sompolinsky, Ginzburg considered the effect of a per- 



turbation on a spin glass which is already in equilibrium |jTT|. This is different 
from our approach since we do not assume that the system has reached equi- 
librium and we find that it never does. Furthermore the mechanism for 
barrier crossing we here invoke is not related to the size of the system but 
rather to its age. 

As mentioned in the introduction we work here with N infinite and any 
infinite time scale arises not because N or any other parameter go to in- 
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finity but it is the very age of the system which imposes the rhythm of 
the relaxation, which eventually becomes very slow. The assumption that 
the correlations go to zero in this context is just related to weak ergodicity 
breaking and the observable aging effects and does not contradict the statics. 
Furthermore, since we are considering finite albeit long times the solution for 
the correlation and response functions is unique. Yet the fast relaxation for 
small time differences (but large overall times) is identical to the one found 
by Sompolinsky-Zippelius with the only change of reinterpreting the state as 
a trap or channel from which the system always escapes. 

As noted in section ^ all the results in this paper are invariant with 
respect to reparametrizations in time. This invariance is not a true property 
of the dynamics, but is the result of using equations of motion that are, for 
the large time-differences, only asymptotically valid. The true solution has to 
choose one asymptote between all the family of reparametrizations we have 
obtained. This problem is quite common in the asymptotic matching of the 
solutions to differential equations. The application of such concepts to the 
spin glass problem is still an open question. Many of the most interesting 
results (decay law of the energy, of the magnetization, etc) will only be 
available when one will be able to go beyond reparametrization invariance. 

There are quite a few open questions even at the level of reparametrization 
invariant results. One would like to have a deeper understanding of the 
function X{C) and the dynamical generating function Pdiq)- It may be that 
some general theorems can be derived for the asymptotic non-equilibrium 
regime. 

Some of the questions discussed here are quite general, and it would be 
interesting to try them in other models. 
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Appendix A 



In this Appendix we show that assuming that f{x,y) is smooth within 
a discrete scale, the upper limit of the scale acts as the neutral {i.e. like 
the identity in a product) and that the lower limit acts as the zero in the 
product. 

The associativity relation ( ^.1.51) implies 



df{x,f{y,z)) df{w,z) 



dx 



dw 



df{x,y) 
dx 



(A.l) 



■w=f(x,y) 

Consider an isolated fixed point a* separating two discrete scales and set 
y = z = al in the above equation: 



df{x,al] 
dx 



df{w,al] 



dw 



. 



(A.2) 



w=f{x,al)^ 



This admits the solution 

f{x,al) = g{al). (A.3) 

Since /(x, a*) is continuous and /(a^,aj) = a^, g{al) = a^. For x > this 
is a possible solution. For x < a*, /(x, a*) < x < a* so this solution in not 
admitted in this case. 
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The other solution to eq. ( |A.2| ) is 

df{w,al 



dw f, ,^ 

w=f(x,al) 

Consider the successive fixed point < a^. f{x,al) satisfies 

a*2 < fix,al) < al 



(A.4) 



(A.5) 



and, because of eq. (|5.1.2| ), /(x, aj) is a monotonically increasing function of 
X. Equahty on the left takes place when x = and on the right when x = al- 
Hence, for every w within the discrete scale we can solve w = f{x, al) for x. 
Eq. (|A.4| ) becomes 

riff,, n*\ 

1 (A.6) 



df{y,al) 



dy 

Wy G (og, al). The solution is f{y, al) = y + k{al); since f{al, al) = al then 
k{al) = and we finally have 



f{y,a*i) = y ■ 



(A.7) 



This solutions is only possible if y < al. Otherwise y = f{y,al) < al and 
this is incompatible with y > al. 

Hence, for x within a discrete scale, < x < a^, eqs. ( |A.3D and ( |A.7| ) 
imply 



f{x,a*^) 
/(x,a*) 



''2 ) 



X 



(A.8) 



and, ttg and al are the zero and neutral, respectively. 



Appendix B 
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In this Appendix we review some results of formal group theory that 
give the general form of f{x,y) within a discrete scale. Let al and 02 be 
two consecutive fixed points al > Og. We assume that f{x,y) is smooth for 



x,y E (oj, al]. From (|A.8|) we have that al is the neutral element within this 
range. Under this assumption one can show that [^: f{x, y) is commutative 
and can be written as 

f{x,y) = r^o{^{x) + ^{y)) (b.i) 

with (i{z) given by 



dw 



(B.2) 



£(aj) = 0. Because we are within a discrete scale the denominator in the 
integral is positive definite for z' G (05, a]^] and it first vanishes in z' = 
The function i{z) is increasing and negative semi-definite {i{al) = 0). 
We can also define 

jiz) = exp(£(^)) (B.3) 

to obtain 

fix,y)=j-'o{j{x)-jiy)). (B.4) 
Writing (|B.1| ) in terms of the correlations at three times 

^ ^ C {tfnax) train) ^ C (tniax^ tint) ~l~ ^ O C{tinti tmin) (■^•^) 



the crossed second derivative vanishes 

d'^ i O C{tmax, t 



mm J 



max'^^mtn 



dt m.n.T. dt 

The solution to this equation is 



. (B.6) 



ioC{ti,h)=hl{ti)-h2{t2) (B.7) 
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for some functions hi, h2. Inserting this into ( [B.5| ) we see that hi{t) = 
h2{t) = h{t). If we now define X{t) implicitly by 

C{t,X{t)) = a* (B.8) 

a* the largest correlation in the scale, for large t we have 

lim h{t) - hiX{t)) = i{a*) = . (B.9) 

t — *oo 

Defining h{t) = exp{—h{t)) 

3oC{t,M) = ^- (B.IO) 



with 



limMMl.,.. (B.U) 

t-<X) h{t) ^ ' 
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Figure Captions 



Figure 1 A sketch of the function /(a, a) vs. a, a & [0, 1]. 

Figure 2 x{t + tw, tw) vs. C{t + ty,, t^) The hnes have been obtained sim- 
ulating a hypercubic spin glass cell of dimension = 17 at a subcritical 
temperature T = 0.2 for = 30, 100, 300, 1000, 3000. The points represent 
the static curve for the SK model. 

Figure 3 Plot C{t^ax,t) vs C{t,t^), < t < t^ax, for fixed C{t 

max ! '^w I 

0.7. D = 15 and T = 0.2, the four curves correspond to = 100, 300, 1000 
and 3000. In the inset log-log plot, area vs. t^, D = 15, T = 0.2 and ty, = 30, 
100, 300, 1000, 3000. 
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